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1. Introduction 

Problems defined on finitely connected (partially) random graphs have been studied 
intensively in various fields of science. Examples from physics are models of spin glasses 
and related magnetic systems [TJ[31[31[2J[S1[51[71[H1[H1 [TO] • A second field is information 
theory and computer science, where calculations involving finitely connected random 
graphs emerge in the context of error correcting codes [ITJ [12j El HH [15l [TOJ [17l [18] , 
lossy data compression [HI [201 Ell HU 123 H31 IH1 US], CDMA multi-user detection 
[13 [H US], and combinatorial optimization [3U1 (SI GH GH GS] • In biology and the 
social and economical sciences one finds processes on finitely connected random graphs 
in the context of neural |35J HH] as well as proteomic and gene regulation networks, 
and small world models [37J GUI GM [40]. In all these fields, techniques of statistical 
mechanics have been decisive in making progress. The initial focus in research has been 
on establishing the equilibrium properties of processes on finitely connected random 
graphs, mainly by applying replica theory and the cavity method. In a second wave 
also the dynamical properties of processes on finitely connected random graphs have 
begun to be investigated in detail, see e.g. [41] . [42 [ [43 l [44 [ [45 ], [46 l [47l [48 l [49 [ [50], 
In real- world applications involving finitely connected random graphs, there are 
many situations in which it is essential for dynamical properties to be understood 
quantitatively, this is especially true for technological applications, such as the 
decoding of error correcting codes and the detection dynamics of CDMA multiuser 
detectors, and for biological information processing systems where the absence of 
detailed balance rules out equilibrium methods. 

In most of the problems described above, the dynamical variables and their 
interactions are represented as nodes and edges of finitely connected graphs, 
respectively. The simplest such graphs are Poissonian ones, i.e. sparse Erdos-Renyi 
graphs with a Poissonnian degree distribution in the thermodynamic limit. However, 
the broad spectrum of problems to be understood demand dynamical techniques that 
are able to treat more general random graph ensembles. The dynamics of processes 
on graphs drawn from ensembles with arbitrary degree distributions have so far been 
studied using dynamical replica theory (45j [48] and the cavity method [50]. One 
particular dynamical formalism, which enjoys the appeal of full exactness (if it applies), 
is the generating functional method of De Dominicis [51] . This method was first used 
by Hatchett et al to investigate the parallel dynamics of bond-disordered Ising spin 
systems on finitely connected random graphs [44] . but their study was limited to 
finitely connected Poissonian random graphs. In information theoretic problems and 
modeling real-world systems, there are many examples which are characterized by a 
finitely connected random graphs with a specific degree distributions. For example, 
a power-law distribution is often utilized to discuss 'small-world' networks. In the 
framework of error correcting codes, a one-point distribution and specific (complex) 
degree distributions which give more high performance are applied. 

In this paper we generalize the analysis of [44J: we use generating functional 
techniques to analyze the parallel stochastic dynamics of Ising spin models defined 
on finitely connected random graphs, which are drawn from ensembles in which the 
degree distributions can be chosen arbitrarily (including a power-low distribution, a 
one-point distribution and so on). We first derive general dynamical order parameter 
equations, which give a transparent exact description of collective processes in finitely 
connected Ising systems. We then consider the simplest case of fully asymmetric 
finitely connected random graphs. Here the theory acquires a simple form due to 
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the absence of the loops, and the dynamics becomes very simple. Away from fully 
asymmetric graphs, we calculate the first few time steps exactly, and construct (for 
fully symmetric graphs) approximate equilibrium solutions. To confirm the validity 
of our theory, we present numerical results for some typical conditions and typical 
graph ensembles; although our theory can handle arbitrary degree distributions, our 
examples are mostly regular random graphs (for simplicity). 



2. Model definitions 



Let us consider a system of N Ising-type spins, placed on the edges of a finitely 
connected directed random graph with an as yet arbitrary degree distribution. The 
dynamics are given by a Markov process which represents synchronous stochastic 
spin alignment to local fields. The probability Pt(c) of finding the microscopic state 
er = (cti, • • • , (7jv) G { — 1, 1}^ at time t can be written as 

P t (a)= ]T WW<x|<x']P t -i(<x'), (1) 

N p 0<Tihi(<r' ,t-l) 

where the hi(cr, t) are local fields, defined as 



1 N 

hi(<r, t) = - ^2 r :f , :, JT j + ( 3 ) 



They involve a connectivity matrix c = {c^} G {0,l} Ar><JV , whose entries specify 
which spins interact, and define a (generally directed) random graph. The parameters 
9i{t) G K are time dependent external fields, and c > The bond strengths are 
symmetric, i.e., = Jji, and are drawn independently from a bond distribution p( J). 
Wc define the degree A;,; of node i (i.e. the number of links to the node i) as 

N 

fci = 5^Cij, (4) 

(this would often be called the 'in-degree'). The entries of the matrix c are chosen 
randomly according to the following connectivity distribution, in which all N degrees 
ki are constrained, 

N N \ / N 



n i[p( c v oteicij ) j f n ^,Ef =1 

i=lj>i ' \=1 

= — rriv ^ 

E 1111^)^14) IliEM, 



2 — 1 j>Z 



where 



P(cji|c tf ) = e*ci„c„ +(l-e) 



+ I 1-4 15. 



(6) 
(7) 
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(with the Kronecker symbol S mn — 1 if m = n, and S mn = otherwise). All 
fcj are randomly and independently drawn from a given degree distribution p(k), 
with ^ k kp{k) = c, so c = lim^-_ >c>0 SjLi c ij- This procedure generates 

an ensemble of random graphs, with a prescribed degree distribution p(k) and a 
parameter e that controls the symmetry of the graph. For e = 1, the connectivity 
becomes symmetric. In the remainder of this paper we will write averages over the 
bond variables { Jy} as (• • •) j = JdJ p(J)(- ■ ■) and averages over both the microscopic 
graph and bond variables, i.e., over {c^, }, as [•••]. 



3. Generating functional analysis 

3.1. The disorder- averaged generating junctional 

We follow the approach of [H], but apply it to the present generalized spin model. We 
assume that the macroscopic behaviour of our system depends only on the statistical 
properties of the disorder. The joint distribution of any trajectory <x(0), • • • , cr(t m ) is 
given by products of the individual transition probabilities of the Markov chain: 

t m -i 

P[ff(0),--- )< 7(t m )]=p [ff(0)] II W[a(t + l)\tr(t)], (8) 

t=o 

where po[°"(0)] represents the initial conditions. The generating functional Z[ip] for 
the process is now defined as [5T] 



/ r N *m TV 

* <- i=l t=o J ' 

where (■ • ■) denotes averaging over the microscopic process, viz. 

(•••)= E E P H0),---,a(t m )}(--.), (10) 

o-(o)e{-i,i} JV o-(t m )e{-i,i} N 

and if) — (ipi(t)) denote the generating fields. We isolate the local fields at all stages by 
inserting appropriate integrals over integral representations of the Dirac delta function: 

N t m -l r , N 



1 = 



/ {dhdh} j[ j[ cx P ihi(t) ( hi(t) - - c ij j ij°j(t) - hi*) 

J i=i t=o L V c i=jLi 



(11) 



where {dhdh} = YliLi Y\t=o 1 [dhi(t)dhi(t)/2it\. The generating functional then takes 
the form 



N t m -l 



N 



Zty] = / {dhdh} E" ' E Po[ ff (°)l ex P -~E E M*)E^-^^w 

ct(0) c(t m ) L C i=1 t=0 j-^j 

JV t m -l 

x J~J e ift i (t)[/tj(i)-6l i (t)]-i'0i(t)o-i(t)+^<7i(t+l)/ij(t)-ln2cosh[/9h i (t)] 

Hereafter we will change our notation from <r(t) = (<7i(i), • • • , crjy(i)) (the TV-spin 
configuration at time t) to <Ji = (crj(0), • • ■ ,o~i(t m )) (the path taken from i = to 
i = t m by spin i). Similarly we define single site paths for external, local and conjugate 
fields, viz. 9 l = (0;(O), • • • , 0i(t m )), hi = (hi(0), • • • , hi(t m )), etc. 
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Using the integral form of the Kronecker delta to represent the degree constraints, 

r 2 T , r / N 







2ir 



exp 



iu>i k 



(13) 



the term in (|12p containing the disorder {c^, J^} becomes 



exp 



N t„ 



N 



;E E M*)E c y J ^w 



=i t=o 



^(n/s 



TV 



do;. 



Z c 

t — _l 

+ (1 -e)e 



2tt 



exp 



AT AT 



2iv EE 

i=i j=i 



ee 



-^(cri-hj-\-(Tj-hi)—i(u)i -\-Ljj ) 



+ (l-e)e - 



+ £- 



(14) 



where Z c denotes the normalization constant of the connectivity distribution p(c) 

in ([5]), i.e. Z c = EeCnjli n^>jP( cij)p(c^lcij))( njIi ^,Ef =1 c<j)- Details on thc 
calculation of (fT4|) can be found in |Appendix A| To achieve site factorization we 
choose factorized homogeneous initial conditions, i.e. po[°'(0)] = lli? , o[ 'i(0)], a nd we 
introduce the following order parameter functions 

1 N 

P(a,h) = -J2 S <r,<rAh-hi), (15) 



1=1 

N 



Q((t, h) = — ^ 5o- J<r4 5(h - hi)e" 



(16) 



»=i 



It should be noted that one could also have used the order parameter function 
R(tr,h,uj) = jr 2i=d fi<T,<Tifi(h — hi)S(u> — LOi) to achieve site factorization in thc 
generating functional. The reason for us to work with (fT5|) and (JTHJ) is that the 
latter will have transparent physical interpretations. We determinne the initial state 
<7j(0) according to the distribution po[ci(0)] = i[l + Ci(0)m(0)], where m(0) denotes 
the initial magnetization. 

To introduce the two order parameter functions in the generating functional, we 
use the integral form of Dirac's delta function and insert 



f{dPdP}exp iNj2 J&h P{<r,h) 



i N 

P{(T,h)-—J2 S ^i 6 i h - h 



(17) 



{dQdQjexp iNY^ JdhQ{cr,h) 



1 N 

Q(a, h)- o~a,<r z 5{h - hi)e~ 



(18) 



where {dPdP} = J\ h[dP(cr, h)dP(a, h)N/2n], and we choose the equivalent 
definition for the short-hand {dQdQ}. We then have 



1 



Z[tf>] = — / {dPdPdQdQ}. 



t N^[{P,P,Q,Q}] 



(19) 
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*[{P, P, Q, Q}} = + | ]T / dhdh' j4(<t , h; </, fc') + L[{P, Q, 0}} 

+ iJ2 J dh P(<r,h)P(cr,h)+iY^ J dh Q((T,h)Q(<r,h) (20) 



with 



A(a, h; a 1 , h') = Q(<7, h)Q{tr' \ h l ){ee-^^- fl ' +<T '^) 



J 

er-h' \ 



+ P(cr,h)Q(a',h')((l -s)e—c 
+ Q(<r, h)P(cr', h')((l - e)c-^'- h )j (21) 



and 



1 N 

L[{AQ,0}]-^E ln E^H°)] 



N, 

l—l CT 



^ dh(t)dh(t) e Mt)[h{t)~e t (t)]+fMt+i)h(t) 



t=0 



2ir 2cosh[/3/i(t)] 



xe- {p{ °> h){ -^[Q{<T,h)f\ (22) 

In the above expressions we have neglected those terms that will vanish for N — > oo, 
and we have removed the now redundant generating fields tp. Upon applying the law 
of large numbers, the term L[{P, Q, 6}} simplifies to 

oo 

L[{P,Q,6}} = ^p(fc)ln^poWO)] 



k=0 



X 



tm-1 „/,i,;/a ifc(t)[/i(t)-e(t)]+0<r(t+l)h(t) 



jj d/i(t)d/i(t) e" 



2tt 2cosh[/3/i(t)] 
xe-^MH^IQf^ft)]'. (23) 



Functional extremization of *f?[{P, P, Q, Q}} with respect to the kernels P, P, Q and 
Q, i.e. working out the equations S^/SP = d^/SP = S^/5Q = 5^>/SQ = 0, gives the 
following functional saddle-point equations: 

P(cr,h) =icJ2 fdh' Q(a',h')((l-s)e-^- k ')j, (24) 

oo 

P(<r', h') = X>(*0<<W<^ - ( 25 ) 

fc=0 

Q(a, h) =icJ2 I Pi*', - e) C -^'- k )j 

a-' J 

+ icJ2 I dh 1 Q(a', h')(ee-^^ k '+°'-V)j, (26) 
Q(^)=±kp(k)( S '^-^ ) ) , (27) 
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with a measure (■ • which is defined as 

EtrJdh f(cT,h)M k (cT 7 h\0) 



M fe (<7, h|0) = e-'^^t-iQ^, h)] k p [a(0)} 

' ' ~dh(t) e Mt)[Ht)-8(t)]+l3a{t+l)h{t) 



n 

t=0 



2tt 



2 cosh[/3/i(i)] 



(28) 



(29) 



Performing an inverse Fourier transformation of P(cr, h) and Q(cr, h) gives, 
respectively, 



P{a\6') = dh e- w '- h P((r,h) = ^(fcKW'W,*, 



k=0 



Q{<t\0')= dhe- i0 ' h Q((T,h) = Y j kp(k) 



fc=i 



-i<9(<r, h) I e+e 



(30) 
(31) 



The order parameter P(cr\0') is the disorder-averaged probability of finding a single- 
spin trajectory <x with modified external fields 0+0' (consisting of the original external 
fields and the supplement 0'). We will consider the meaning of the order parameter 
Q{a\6') later. The present situation is similar to that in the related studies [4"4l 141) . 
In terms of P(cr\0') and Q(cr\0'), the order parameter functions P(tr, h) and Q(cr, h) 
can be rewritten as 



P(er,h) =ic(l-e) 

Q(ct, h) = ic(l - e) ^(e"^ CT '- fl P( < T'|0)),. 



+ ice 



r'h 



g(<r'|-«T)) 



(32) 



(33) 



Here we have also used the fact that P{cr\0') and Q(cr\0') are both normalized with 
respect to summation over er, a property which is demonstrated in the next section. 

After substituting (|3"2l |3"3"]) into (|3"01 l3"Tj) and integrating over h, we finally arrive 
at the following compact closed-form equations: 

k 



lxj / ft „ 

PH0O= 5>w n /^pwe 

fc=0 \«=1 



sQ(<r e \-J e cr) + (l-e)P(cr e \0) 



r , m1 'fr 1 exp(/3aft + l)[fl(f) + 0'(t) + 1 Eti -W*)D 
x p \a(Q)\ r (34) 

2cosh(/3[0(t) + e>(t) + \ Eti -W*)]) 

sQ{<j t \-Jta) + {l-s)P{a t \Q) 



Q(<r|0') = 53— p(fc+l) M] dJePWYl 

k=0 ° \=lJ <r t 



^ 2cosh(/3[0(t) + 9'(t) + i Eti -W*)]) 

The equation for the order parameter P(cr|0') contains the degree distribution in its 
bare form p{k). The equation for Q(cr\0'), on the other hand, involves the deformed 
degree measure ^^-p{k + 1). This is the only difference between the two expressions. 
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These above two equations are closed and exact and completely general; they cannot 
be simplified further without making specific parameter choices or assumptions. 

In the case of Poissonian graph [33] , the result looks like being represented in 
terms of only the local field distribution. However, in general both the local field and 
the cavity field are needed to represent the macroscopic dynamics. In the next section, 
we discuss the meaning of equations (|34|) and (|35|) in detail. 

3.2. Physical meaning of order parameter functions and interpretation of closed-form 
equations 

Starting from (|15[) and (I16p and using manipulations similar to those used in deriving 
(|22p . we can infer the physical meaning of P(cr\6') and Q(cr\6') at the saddle-point. 
This gives 

JV 

(36) 



1 N 

p(cr\e% addle = (p(o-|0')>* = j^J2( s ^ i ) 



i N 

Q(<r|0')Uddic = (Q(<t|0')>* = ^E<^ 

i=l 



, (37) 

+6i+6' 



where the brackets (• • denote evaluation of the argument for the microscopic process 
©, i.e. 

_ J{dPdPdQdQ}e N ^ p ^(---) 
[ '"'* J{dPdPdQdQ}e N *t{ p > p >Q>Q}] 

Details on the derivation of (|36l l37|) can be found in |Appcndix B| We may now 
conclude that Q(cr\6') represents the disorder- averaged probability of finding a single- 
spin trajectory er in the system from which one site is removed randomly, and in 
which the external field paths of spins i previously connected to the removed site are 
modified to 9i + 0'. Similarly, P{cr\6') represents the disorder-averaged probability of 
finding a single-spin trajectory er in the system in which the external field paths of a 
randomly drawn site are modified to Bi + 8' (without removing sites). 

Our present general equations (l34l l35|) have a clearer interpretation than those 
obtained for strictly Poissonian graphs ; in the latter graphs the distinction between 
(|36p and (|37|) is invisible as a consequence of the property ^±Ip(fc + 1) = p(k) of the 
Poissonian degree distribution. To calculate the probability of a single-site path er, a 
random number k is firstly drawn from the degree distribution p(k). This parameter 
k denotes the number of sites that contribute to the field at the central site. All k 
associated spin paths of the attached sites <j\ , • • • , er^ are sampled from their respective 
distributions eQ(crg\^ Je<r) + (1 — e)P{cri\Q), which depend on the central site's path 
er. By definition, each site I contributes to the field of the central site. Hence with 
probability e the central site will contribute \ Ji<? to the field paths of site £, hence 
the term eQ(cri \ - Je,cr) in the path measure for £; with probability 1— e the central site 
will not contribute to the fields of site £, hence the term (1 — e)P((Tg\Q) in the path 
measure for £. This process makes it possible to take into account dynamically the 
effective retarded self-interaction induced by connection symmetry. Figure [T] shows a 
schematic illustration of this interpretation. 

Equations ([36| and (|37|) show explicitly that the order parameters P(er|0') and 
Q(er|0') are normalized, i.e. that ^ CT P{cr\6') = 1 and £ CT <2(er|0') = 1. We have 
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£<2(<Ti|iJi<r) 

+ (l-e)F(<r 1 |0) CTl 



eQ{cr 2 \\j 2 cT) 
+(l-e)P(<7 2 |0) 




eQ((T 3 \^ c J 3 a) 
+(l-e)P(<r 3 |0) 



Figure 1. Illustration of the interpretation of our closed-form order parameter 
equations, showing how the measure for the spin paths it of a central site with 
three incoming links is related to the measures of the connected sites under 
modified conditions. Each connected site has with probability e an incoming 
link from the central site. For N — > co our graphs are locally tree-like, hence the 
three sites i = 1,2,3 are mutually correlated only via the central site. 



used this property to derive (I32|) and (|33|) . In the special case of Poissonian graphs, 
i.e. graphs with p(k) = e~ c c k /k\, the degree distribution obeys 

+ 1) = p(jfe) (39) 

c 

and hence one always has P(er\9') — Q(cr\0'). As a consequence our two closed-form 
order parameter equations reduce to a single closed equation: 

k 



W) = EV" II d ^wE 



eP(a e \^a) + (l-e)P(o-/|0) 



.. . c 

k=0 H=l <r e 

t,„-l i n , , . , , 1 v^fe 



r rn x, tt exp(/?cT(t + l)[gft)+^(t) + lELi^^W]) ,„ n x 
xpop 5 E ■ (40) 

and we thereby recover the results of reference [44] . 

4. Fully asymmetric connectivity 

4-1- The reduced theory 

We first consider the case of fully asymmetric connectivity, i.e. e — 0. Here the 
situation is mathematically almost identical to that case of the Poissonian graph [44J . 
Equation (|3"4")) once more closes in terms of P(<x|0), and we find 



oo / k „ 

p(a\o)= X>( fe )(ll /dJ,p(J^Ph|o; 

l — n \0 — i **■ i-r „ 



xpok(o)]n lexp(/3g(t+1)[ ^ )+ -F tiJ ^ W]) . (4i) 

H 2cosh(/3[e(t)+iEii^(*)]) 
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Summing both sides of (|4"Tj) over cr, except for the entry a(t + 1), leads us to single- 
time spin probabilities P(a(t + 1)|0), which are marginal probabilities of the full path 
measure P(er|0): 

P(a(t + 1)\0) = 5>(*)(II /d^PWE P M*)|0) 



exp 



G9ff(t+i)[ff(t)+iEti^(*)]) 



(42) 

2cosh(/9[0(t) + ±Ei=i -M*)]) 
It should be noted that the probabilities P(cr(t + 1) 1 0) depend only on P(cr(i)|0), for 
any i. This means that there is no effective retarded self-interaction, i.e. there is 
no effective short loop in the graph with fully asymmetric connectivity. Using the 
following two general identities 

P(a(t)\0) = i[l+«r(i)m(t)] (43) 
P{a(t),a(t')\0) = -[l+m{t)a(t)+m(t')a{t')+C(t,t')a(t)a(t% (44) 



both the effective single spin magnetization m{t) — (cr(t)) and the covariances 
C(t,t r ) — (<r(i)cr(t')) can then be written as closed form iterative expressions: 

m(t + l) =j£p(k)(j[^^[l+*m(t)]\(ts&(p 9(t)+^J2 J ^ 

V=l at 



k=0 



(45) 



OO / I 

C(t+l,t'+l) = ^p{k)(Y[ 7[l+m(t)<r < +m(t / )oi+C(t,0o-/o/] 



k=0 



= 1 (Tf.crJ 



x /tanh ( 



1 fe 

9(t)+-yjto-t 



tanhl f3 



1 fc 



(46) 

from (|4"2"|) , with m(0) following from the initial conditions. FigureOshows a comparison 
between theory and numerical simulations with respect to the time evolution of the 
magmetization m(t) on a regular asymmetric sparse graph (e = 0) with the degree 
distribution p(k) = Sk, c - The theoretical results are in excellent agreement with the 
numerical simulations. 

When taking the limit of c — > oo, the internal fields ujt(t) = - Ez=i simplify 
to Vk(t) — ► (J)jm(t). In this limit we therefore have 

m(* + 1) = tanh(/3[6»(t) + (J)jm(t)]), (47) 

C(t,t') = m(t)m{t'). (48) 

In the absence of external fields, i.e. for = 0, a P^F transition occurs at /? = /3 C , 
which is given by /3 c (J)j = 1. This situation is identical to that described in [44] . 



^.2. Time evolution and phase diagrams 

We here specialize further and consider the physics described by the e = equations 
T5l HH) for the case of having binary random bonds: 



p(j') = 1 -{1 +11 )8{J'- J) + \(1- V )8(J' + J), 



(49) 
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with r] £ [—1,1]. For such bond statistics the iterative equation (|4"5f for the 
magnetization reduces to 

k 



(50) 



k=0 

x tanh(/?[0(i) + -(2r-k) ) 

For zero external fields, i.e. 9(t) = for all t, and upon assuming that a stationary 
state exists, the stationary state magnetizations are given as the solutions of the fixed- 
point equation m — F(m), with 



fc=0 r=0 



l±^) r (i^)" r tanh(^^) (51) 



pj(2r-ky 



The map F(m) is anti-symmetric, and hence always has the trivial fixed-point 
m = 0. This fixed-point is unique for small rj, whereas for larger rj nontrivial fixed- 
points bifurcate (provided the inverse temperature (3 is sufficiently large), marking a 
transition P^F from a paramagnetic to a ferro-megnetic state. To determine whether 
this transition is continuous, and if so find the critical value ry c , we can expand F(m) 
in powers of m, giving 

A ■k\2r-k 



F(m) =rjm^2 P( k ) X] ( r ) ~^k~ tanh 



fc=0 



r=0 



0J(2r-k) 



1 OO k , 



fe=0 



(2r-fc)(4r 2 -4/cr + fc 2 -3fc + 2) 
2 k 



tanh 



/3J(2r-k) 



C(m 5 ) 



(52) 



The cubic term can be confirmed to be non-positive. Therefore there is no evidence 
for a discontinuous transition, and the critical value rj c can be obtained as 



k 



k=0 r=0 



fc\ 2r-fc 



C) 



tanh 







J(2r-k) 



1. 



(53) 



In a similar way we can inspect the existence and location of a spin-glass phase. Upon 
putting m{t) = and 6{t) = in (|46p . one finds that the time-translation invariant 
covariance q = linii-^oo lim^oo C(t + r, t) are given as the solutions of q — G(q), with 



G(q) 



k=Q 



P( k )(l[ Yl J^+^eli) tanh 



1=1 <7i,a' f 



tanh 



/3J 



(54) 

It can be confirmed that G(0) = 0, G(q) < 1 and d 2 G(q)/dq 2 > for q e [0, 1]. Hence 
G((j) < q for € (0,1]. Since q = G{q) has no non-trivial solutions, no spin-glass 
phase exists for e = 0. 

Figure [5] shows a comparison between theory and numerical simulations with 
respect to the time evolution of the magmetization m(t) on a regular asymmetric 
sparse graph (e = 0) with the degree distribution p(k) = 5f. tC an d zero external 
fields 6(t) = 0. The theoretical results are in excellent agreement with the numerical 
simulations. Figure [3] shows the resulting phase diagram in the (77, 1/0 J) plane, for 



Dynamics on finitely connected random graphs with arbitrary degree distributions 12 



0.6 
0.5 
0.4 
0.3 
0.2 
0.1 


-0.1 



1 1 1 — 


1 1 


tB B^ BB ^ n =0.8 


□ theory 




o simulation 


{a r\=0A 




1 1 1 1 1 



10 



15 
t 



20 



25 



30 



Figure 2. Comparison between theory and numerical simulations with respect 
to the time evolution of the magmetization m(t) on a asymmetric (e = 0) finitely 
connected random graph with a degree distribution p(k) = <5j, c and zero external 
fields 8(t) = 0. The initial magnetization is m(0) = 0.4. Squares: theoretical 
results for c = 3, /3 = 3 and n 6 {0.4, 0.8}. Circles: simulation resuls for N = 10 5 
spins (averaged over 10 runs). 



the example of a regular sparse graph with the degree distribution p(k) = 8k >c and zero 
external fields 9(t) = 0. For nonzero temperatures, the c = 2 regular sparse graph has 
only a paramagnetic phase (with a zero temperature P— >F transition only for rj = 1). 



5. Arbitrary connectivity symmetry 

5.1. Numerical solution for short times 

Equations (|34|) and (|35[) are closed and exact, but highly nontrivial, and it is not 
obvious that they can be simplified further. However, if the bond distribution is of 
the form (j49|) . the space on which our equations are defined at least becomes finite 
dimensional. In that particular case we can achieve closure for the following reduced 
order parameters: 

P(o-) = P(<r|0), Q(<r\<r') = Q(a\-a'), (55) 

c 

since from equations ([Ml 155)) one can extract 

oc , k 1 

P(<r) = 5>( fc )(ll £ -[l+ m ]J2m^\n<r) + (l-s)P(a e 
fc=n V=lr £ =±l <T t 

, , m1 'fr 1 exp(M*+ 1) W) + 1 W{t) + YH=i Tien®] ) 
x pn \cr 0) — ; , (56) 

i\ 2c 0S h(mt)+iw(t)+j:l 1 Ti<j i (t)}) 

Q(a\a')= Ys—Pik+D M] E ^l+^]]>>Q(^^) + (l- e )P(<T*)] 



c v 'V 11 ^ 2 

fc=0 V=lTi = ±l 




Figure 3. Phase diagram in the (tj, l/(/3 J)) plane of the ± J random bond model 
on a asymmetric (s = 0) sparse graph with the degree distribution p(k) = St c 
and and zero external fields 9(t) = 0. Solid lines: P — > F transition lines 
for c 6 {3, f0,30, 60}. Dashed line: P — ► F transition line at l/(/3J) = n 
corresponding to c = oo. 



r rn s! t ? T 1 exp(/3a(t + 1) [0(f) + j [a'(t) + W*)] ) ,, 7 , 
x p cr(O) — t , (57) 

with cr' G { — 1, l} tm . Equations (|56|) and (|57|) can be solved numerically by iteration. 
The order parameter fucntion P(er) is the disorder-averaged probability of finding 
a single-spin trajectory cr = (<x(0), • • • , • • • , <j(t m )) with zero external fields. 
Therefore the magnetization is given by 

m(t) = 5>(t)P(<r). (58) 

cr 

Figure 2] shows a comparison between theory and numerical simulations with respect 
to the time evolution of the magnetization m(t) on a regular symmetric sparse graph, 
i.e. e = 1 and the degree distribution is p(k) = 8k tC . The theoretical results are in 
good agreement with the numerical simulations. In the case s = 1, the numerical 
analysis in fact simplifies slightly: since (|57|) no longer involves P(<r), one can first 
solve (|57|) for Q(er|er'), and then substitute the solution into (|5S|) to obtain P(er). 

5.2. Approximate stationary solutions for fully symmetric connectivity 

We next consider approximate stationary solutions of our macroscopic equations. 
Detailed balance holds only for s = 1. Since we here discuss dynamics with parallel 
updates, the equilibrium state for e = 1 does not have a Boltzmann form but involves 
Peretto's pseudo-Hamiltonian [52]. In the equilibrium state initial conditions are 
required to be irrelevant, therefore we may shift the initial and final times to — oo and 
oo, respectively. We also choose zero external fields, 9(t) — 0. To find approximate 
stationary solutions, we propose the following ansatz: 

r „ J3a(t+l)[h+e'(t)] 

p^) = j^nh)U 2co ^ [h+m] y ^ 
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Figure 4. Comparison between theory and numerical simulations with respect 
to the time evolution of the magmetization m(t) on a symmetric (e = 1) finitely 
connected random graph with a degree distribution p(k) = 8^ c . The initial 
magnetization is m(0) = 0.4. Squares: theoretical results for c = 3, /3 = 3 and 
rj = 0.4. Circles: simulation resuls for N = 10 5 spins (averaged over 10 runs). 



Q{tr\e') = Uh ewIT 

•J + 



/3a(t+l)[h+g'(t)] 



(60) 



{ 2cosh(/?[/i + 0'(i)])' 

where V(h) denotes an effective local field distribution, and Q(h) denotes an effective 
cavity field distribution j4]. Substituting this ansatz into the right-hand sides of ([34]) 
and (|35|) results for large c in (see |Appcndix C| for details): 

P(o-\0')= Uh\^P(.k)\T[ UhtdJt p(J t )Q(h t ) 



x 8 h 



1 k 

— tanh 1 [(tanh/3/i^)(tanh 



n 



e P<r(t+l)[h+9' (t)] 

2cosh{/3[h + 9 / {t)}) 



/3J\ 
c ' 



(61) 



Q{a\d') 



[ dh \j2 — p(A+l)fjJ [dh t dJt P(Ji)Q(h e 

xS ( h ~ ^^tanh _1 [(tanh/3/i £ )(tanh— )]j| 



n 



e l3a(t+l)[h+B' (t)] 

2cosh(/3[/i + (9'(t)]) 



(62) 



Comparing [55)1 to ([521 [50)1 then implies the following relationships for the effective 
field distributions V(h) and Q(h): 

k 



CXJ / ^ /* 

= UhtdJt p(Je)Q(hi) 

k=0 H=1 J 
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xd(h- -Tetania 1 [(tanh /3M (tanh — )] Y 

q w = e ( n / dhedje p( j c)Q( h 

k=0 \fc=lV 



(63) 



6 ( h ~ \ tanh _1 [(tanh /3/i £ )(tanh —)]) . 



(64) 



Equation (|64|) has a closed form with respect to Q(h); its solution is substituted into 
(|63[) to generate V{h). In the special case of Poissonian graphs, i.e. p(k) — e~~ c c k /hi, 
we observe that V(h) = Q(h), and we therefore have just one closed equation: 



fe=0 ' V=l"' ' 



x 5^- i^tanh-^^anh^Ctanh— )]V (65) 

We thereby recover for Poissonnian graphs the result of |44j . which is, in turn, identical 
to the replica symmetric equilibrium solution of the sequential dynamics version of 
the model addressed here [S] . In the reference [3S] , it has been shown that one expects 
the replica symmetric equilibrium solutions of sequential and parallel dyamics to be 
identical. 



6. Discussion 



In this paper, we have applied the generating functional analysis technique to the 
dynamics of Ising spin models on finitely connected random graph with arbitrary 
degree distributions, following in the footsteps of reference [H] (which was limited 
to Poissonnian degree distributions). We have first derived general exact equations 
to represents dynamical properties of the system in the infinite size limit. The 
introduction of arbitrary degree distributions was found to give us very clear and 
intuitive interpretations of the macroscopic dynamics of finitely connected Ising 
systems, in terms of macroscopic path probability distributions involving the evolution 
of both the actual local field and the cavity field. We have already applied our theory 
to error correcting codes |49j . We next aim to apply the theory to other problems in 
the field of information theory, as well as generalize it to include more complicated 
local field definitions which will enable it to be used for the analysis of the dynamics of 
gene regulation systems. Especially in the latter systems, where the graphs concerned 
are finitely connected and directed but where the degree distributions are known to 
be far from Poissonnian, the ability to study dynamics macroscopically for arbitrary 
degree distributions is vital. 
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Appendix A. Calculation of the disorder average 



We here calculate the disorder average. The term containing the disorder, which is 
the left-hand side of (TBI), becomes 



exp 



N tm-l 



i=l t=0 jjti 

1 ( N N f 

c c \=1 j>i 
• t m -l 

- fi-iityCijJijO-jft) + hj(t)CjiJji<Ti(t)] 

t=0 

n / ex p ^ - s c «) ) 

i=i"' L V J=1 /J/ 



x exp 



x exp 

We then have £[ 



j— ^ [hi{t)CijCTj{t) + fej(t)c^(7j(t)] — i(UjCij + CJjCj-t) \ ) 

c t=o I' J' 



(A.l) 



Appendix B. Derivation of the physical meaning of our order parameters 

The physical meaning of the order parameter functions can be inferred by evaluating 
(|36p and ([57)1 . We first present the outline of the derivation of the physical meaning 
of Q(cr\6'), Equation (|37|) becomes 

Q(tr\9')\ saddle — 

i=i 



{dPdPdQdQ}e w *« p < p < Q 



Q}] 



{dPdPdQdQ}e 



iV*[{PP,Q,Q}] 



-i ri iV 



-J] /{dPdPdQdQje 



/Vfi[{P,P,Q,Q}] 



n fe / n/ '.' n/ '.' / ,l v' k -' ' i'ACT r h r h,.o,. < 

7 = 1 °J 



x / dh e" 1 " "■8 <T ,„ i 8{h - hi)e- 1 ^ 



(B.l) 
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where p i (a i ,h i ,h i ,6 i ,aj i ) and 0({P, P,Q,Q}) are defined as follows: 



Pi(ci,hi,hi,Qi, uji) 



1 



. c -iP(<T i ,h l ) e -iQ(o-i,^)o- i " 



(B.2) 



(2tt)*™+ 1 

e i/H(t)[fi i (t)-0»(i)]+/a<T < (t+l)Mt) 

xpo[^(o)] n 

t=0 



2cosh[/3/z l (t)] 

fi[{P, P, Q, Q}] = |( e -2) + | E E / d ^ d/l ' ^ ^ 

+ /dh P(a,h)P(a,h) + Q((T,h)Q(o-,h) . (B.3) 
The term in (jB.lj) that involves w-integrations can be evaluated as follows: 
JJ (j2 I dhjdhjdcjj v L: L i>Aa,.h r h,.0,. Uj )\ \ f dh fT^-H^Mh - fc^e - *"* 



j=l x a- 



life fdh 3 dh 3 du 3 L /); :rr ; ./ (/ ./ (/ .«,.^ ; i 

^ fdhidhdwi <J u *to- l '>p i (* i ,hi,h,6 i + 6',(j i )6, 
II /'"'.- d^j fc ; Pj (f j , /*, , /»,, , 0, 



'1,^3, 

ki-tki-lMi^Oi+O' 

(B.4) 

Substituting (|B.4|) into (jB.lj) then gives us (|37| . Equation ([36]) can be obtained in a 
similar way, since the difference is just the absence of the factor e~ luli . 

Appendix C. Derivation of approximate stationary solutions 



Equations (|61j) and (|62|) are obtained following the reasoning in [44]. We first derive 
(|61j) . using two specific identities. The first applies to a £ {— 1, 1}: 



cosh[/3(a + bo)] = Ae pBa , 



with 



A=Vcosh [/3 ( a + & )]cosh[^-.)], 5=^ln^±| : 

The second identity holds for cr £ { — 1,0,1} and any function /(cr): 
f{s T )=Ce? D ° +f>Ea ', 

with 



C = /(0), P = -!-ln- /(1) 



2/? /(-1) : 



1 /(!)/(-!) 



(C.l) 
(C.2) 

(C.3) 
(C.4) 



Dynamics on finitely connected random graphs with arbitrary degree distributions 19 

We abbreviate njl Ea(t)=±i /( <T )] = {f{°~))<r and substitute the ansatz (pD|) into the 
right-hand side of with e = 1, which gives 

k f r I3a{t+l)[h+0'(t)] 



/ / P C 

P{<r\9') = $>(*:)(( II dJ eP( J e) dh CCOH 



cosh(/3[/i + <?'(*)]) 



AA 2 cosh(/3[0'(t) + § ELi ^(*)D / - 

xx*o n r<^) m sw n — =s— — 

yr / eXp^Dtl + |J<M*-1) + ^+1)}]) \ (C5) 

AA \ 2 cosher (t) + |E?=iM) 

E^)(n / d <w) /<* W)(n%V) 

x TT c /3ff(t+1)[0(t) "5:«=i Bf +3 D '=,t+3 I) fc,t+2+|i ? fc , t <T(t-i)] (c.6) 

r (™ / * /• \ _ e /3<r(t+i)[/i+e'(t)] 

y* {x><Hny dMJ < ^^)ae»))n 2coshW[ , +y(t)1) 

2 A T , , OT 1 A, cosh(/?[/^ + iJ^])' 



X * f ft - j- V J, tanh [3J e + ±- V In + jjf) } 

V /fcfe 2 ^tt cosh(/3[^-ij,]);/ 

/■ f ~ / * /• \ _ pi8a(t+l)[fc+fl'(t)] 

/d/i II / d M^p(^)Q(M)n 



2cash.{fi[h + 6'(t)]) 
s(h- ^ ^ tanh" 1 [(tanh (tanh— )]^ j (C.7) 



where we have put 



^ = Wcosh(/3[^ + cosh(/3[^ - ~J<]), (C.8) 
V c c 

1 cosh(j8[^ + - J A) 

2/3 cosh(P[h e - i Ji\) 

exp(fi Ei=i g iM 
2cosh(/3[0'(t) + ±£j =1 

/ cxp(/3ELi^[^ + §Jd) \ 
1 \ 2cosh(/3[0'(i)+i£Ll„'« CT <!]) / 

D ^ = w ln 7 ; 1 r™' ( CJ1 ) 

2 P / cxp(/3ELi^[^-7^1) \ 
2cosh(/3[0'(t)+i£* = i 'Ml]) / 

/ (Ti,---,(T fc 

exp^^^.^t/t. + fJt]) \ / cxp^ELi^t^-lJd) \ 

2cosh(/3[0'(t) + ± $Xi J^ f ]) / \ 2cosh(/3[e'(t) + i £* =1 / 

/ (Ji ,---,(T{ { \ I CF-\ .■■■,(Tl, 



2cosh(/3[0'(t)+A£f =1 J^]) 
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(C.12) 

To obtain (|C.5[) and (|C.6j) wc have used (|C.1|) and (|C.3|) , respectively. Equation (|S2"]) 
can be derived in the same way. 



